Learning motivation and self-assessment in health economics: a survey on overconfidence in healthcare providers.

INTRODUCTION: Lifelong learning is the foundation for professionals to maintain competence and proficiency in several aspects of economy and medicine. Until now, there is no evidence of overconfidence (the belief to be better than others or tested) and clinical tribalism (the belief that one's own group outperforms others) in the specialty of health economics. We investigated the hypothesis of overconfidence effects and their relation to learning motivation and motivational patterns in healthcare providers regarding healthcare economics. METHODS: We conducted a national convenience online survey of 116 healthcare workers recruited from social and personal networks to detect overconfidence effects and clinical tribalism and to assess learning motivation. Instruments included self-assessments for five learning dimensions (factual knowledge, skills, attitude, problem-solving and behaviour) and a four-item situational motivation scale. The analysis comprised paired t-tests, correlation analyses and two-step cluster analyses. RESULTS: We detected overplacement, overestimation and signs of clinical tribalism. Responders in the physician subgroup rated themselves superior to colleagues and that their professional group was superior to other professions. Participants being educators in other competencies showed high overconfidence in health economics. We detected two groups of learners: overconfident but motivated persons and overconfident and unmotivated learners. Learning motivation did not correlate with overconfidence effects. DISCUSSION: We could show the presence of overconfidence in health economics, which is consistent with studies in healthcare and the economy. The subjective perception of some medical educators, being role models to students and having a superior 'attitude' (eg, morality) concerning the economy may foster prejudice against economists as students might believe them. It also may aggravate moral distress and disrupts interactions between healthcare providers managers and leaders. Considering the study's limitations, lifelong interprofessional and reflective training and train-the-trainer programmes may be mandatory to address the effects.

"ChatGPT, Can You Help Me Save My Child's Life?" - Diagnostic Accuracy and Supportive Capabilities to Lay Rescuers by ChatGPT in Prehospital Basic Life Support and Paediatric Advanced Life Support Cases - An In-silico Analysis.

BACKGROUND: Paediatric emergencies are challenging for healthcare workers, first aiders, and parents waiting for emergency medical services to arrive. With the expected rise of virtual assistants, people will likely seek help from such digital AI tools, especially in regions lacking emergency medical services. Large Language Models like ChatGPT proved effective in providing health-related information and are competent in medical exams but are questioned regarding patient safety. Currently, there is no information on ChatGPT's performance in supporting parents in paediatric emergencies requiring help from emergency medical services. This study aimed to test 20 paediatric and two basic life support case vignettes for ChatGPT and GPT-4 performance and safety in children. METHODS: We provided the cases three times each to two models, ChatGPT and GPT-4, and assessed the diagnostic accuracy, emergency call advice, and the validity of advice given to parents. RESULTS: Both models recognized the emergency in the cases, except for septic shock and pulmonary embolism, and identified the correct diagnosis in 94%. However, ChatGPT/GPT-4 reliably advised to call emergency services only in 12 of 22 cases (54%), gave correct first aid instructions in 9 cases (45%) and incorrectly advised advanced life support techniques to parents in 3 of 22 cases (13.6%). CONCLUSION: Considering these results of the recent ChatGPT versions, the validity, reliability and thus safety of ChatGPT/GPT-4 as an emergency support tool is questionable. However, whether humans would perform better in the same situation is uncertain. Moreover, other studies have shown that human emergency call operators are also inaccurate, partly with worse performance than ChatGPT/GPT-4 in our study. However, one of the main limitations of the study is that we used prototypical cases, and the management may differ from urban to rural areas and between different countries, indicating the need for further evaluation of the context sensitivity and adaptability of the model. Nevertheless, ChatGPT and the new versions under development may be promising tools for assisting lay first responders, operators, and professionals in diagnosing a paediatric emergency. TRIAL REGISTRATION: Not applicable.

Single-rater reliability of a three-dimensional instrument for decision-making in tertiary triage and ICU- prioritization-a case vignette simulation study.

Disconcerting reports from different EU countries during the first wave of the COVID-19 pandemic demonstrated the demand for supporting decision instruments and recommendations in case tertiary triage is needed. COVID-19 patients mainly present sequentially, not parallelly, and therefore ex-post triage scenarios were expected to be more likely than ex-ante ones. Decision-makers in these scenarios may be highly susceptible to second victim and moral injury effects, so that reliable and ethically justifiable algorithms would have been needed in case of overwhelming critical cases.To gather basic information about a potential tertiary triage instrument, we designed a three-dimensional instrument developed by an expert group using the Delphi technique. The instrument focused on three parameters: 1) estimated chance of survival, 2) estimated prognosis of regaining autonomy after treatment, and 3) estimated length of stay in the ICU. To validate and test the instrument, we conducted an anonymous online survey in 5 German hospitals addressing physicians that would have been in charge of decision-making in the case of a mass infection incident. Of about 80 physicians addressed, 47 responded. They were presented with 16 fictional ICU case vignettes (including 3 doublets) which they had to score using the three parameters of the instrument.We detected a good construct validity (Cronbach's Alpha 0.735) and intra-reliability (p < 0.001, Cohens Kappa 0.497 to 0.574), but a low inter-reliability (p < 0.001, Cohen's Kappa 0.252 to 0.327) for the three parameters. The best inter-reliability was detected for the estimated length of stay in the ICU. Further analysis revealed concerns in assessing the prognosis of the potentially remaining autonomy, especially in patients with only physical impairment.In accordance with German recommendations, we concluded that single-rater triage (which might happen in stressful and highly resource-limited situations) should be avoided to ensure patient and health care provider safety. Future work should concentrate on reliable and valid group decision instruments and algorithms and question whether the chance of survival as a single triage parameter should be complemented with other parameters, such as the estimated length of stay in the ICU.

Overconfidence effects and learning motivation refreshing BLS: An observational questionnaire study.

Aim of the study: Regular refresher skill courses are necessary to maintain competence in basic life support. The utilization of these training programs strongly depends on the motivation to learn. Learning motivation may be affected by overconfidence and clinical tribalism, as they both imply a higher competence compared to others, and therefore, a lower demand for training. This study aimed to assess how overconfidence in basic life support competencies affects learning motivation. Methods: We conducted a cross-sectional, observational, multicenter, anonymous online questionnaire survey using validated psychometric tests for healthcare professionals in Germany. Further, we tested participants' knowledge and attitude regarding international basic life support guidelines. The study was conducted between March and April 2022, and healthcare providers from 22 German emergency medical services and hospitals at all levels were assessed. Results: Of 2,000 healthcare professionals assessed, 407 completed the assessment (response rate, 20.4%). We confirmed the presence of overconfidence and clinical tribalism (identity differentiation between social groups) among the 407 physicians, nurses, and emergency medical service providers who completed the survey. Three different learning-motivation groups emerged from cluster analysis: "experts" (confident and motivated), "recruitables" (overconfident and motivated), and "unawares" (overconfident and unmotivated). The three groups were present in all professional groups, independent of the frequency of exposure to cardiac arrest and educational level. Conclusions: These findings showed the presence of overconfidence effects and different learning motivation types in individuals learning basic life support, even in instructors.

Self-Assessment and Learning Motivation in the Second Victim Phenomenon.

INTRODUCTION: The experience of a second victim phenomenon after an event plays a significant role in health care providers' well-being. Untreated; it may lead to severe harm to victims and their families; other patients; hospitals; and society due to impairment or even loss of highly specialised employees. In order to manage the phenomenon, lifelong learning is inevitable but depends on learning motivation to attend training. This motivation may be impaired by overconfidence effects (e.g., over-placement and overestimation) that may suggest no demand for education. The aim of this study was to examine the interdependency of learning motivation and overconfidence concerning second victim effects. METHODS: We assessed 176 physicians about overconfidence and learning motivation combined with a knowledge test. The nationwide online study took place in early 2022 and addressed about 3000 German physicians of internal medicine. Statistics included analytical and qualitative methods. RESULTS: Of 176 participants, 83 completed the assessment. Analysis showed the presence of two overconfidence effects and in-group biases (clinical tribalism). None of the effects correlated directly with learning motivation, but cluster analysis revealed three different learning types: highly motivated, competent, and confident "experts", motivated and overconfident "recruitables", and unmotivated and overconfident "unawares". Qualitative analysis revealed four main themes: "environmental factors", "emotionality", "violence and death", and "missing qualifications" contributing to the phenomenon. DISCUSSION: We confirmed the presence of overconfidence in second victim management competencies in about 3% of all persons addressed. Further, we could detect the same three learning motivation patterns compared to preceding studies on learning motivation in other medical competencies like life support and infection control. These findings considering overconfidence effects may be helpful for safety managers, medical teachers, curriculum developers and supervisors to create preventive educational curricula on second victim recognition and management.

Indications for hand and glove disinfection in Advanced Cardiovascular Life Support: A manikin simulation study.

Background and aim: There are no investigations on hand hygiene during cardiopulmonary resuscitation (CPR), even though these patients are at high risk for healthcare-associated infections. We aimed to evaluate the number of indicated hand hygiene per CPR case in general and the fraction that could be accomplished without delay for other life-saving techniques through standardized observations. Materials and methods: In 2022, we conducted Advanced Cardiovascular Life Support (ACLS) courses over 4 days, practicing 33 ACLS case vignettes with standard measurements of chest compression fractions and hand hygiene indications. A total of nine healthcare workers (six nurses and three physicians) participated. Results: A total of 33 training scenarios resulted in 613 indications for hand disinfection. Of these, 150 (24%) occurred before patient contact and 310 (51%) before aseptic activities. In 282 out of 310 (91%) indications, which have the highest impact on patient safety, the medication administrator was responsible; in 28 out of 310 (9%) indications, the airway manager was responsible. Depending on the scenario and assuming 15 s to be sufficient for alcoholic disinfection, 56-100% (mean 84.1%, SD ± 13.1%) of all indications could have been accomplished without delaying patient resuscitation. Percentages were lower for 30-s of exposure time. Conclusion: To the best of our knowledge, this is the first study investigating the feasibility of hand hygiene in a manikin CPR study. Even if the feasibility is overestimated due to the study setup, the fundamental conclusion is that a relevant part of the WHO indications for hand disinfection can be implemented without compromising quality in acute care, thus increasing the overall quality of patient care.

[Alcohol use and consumption advice of medical students]. / Alkoholgebrauch und Konsumpermission bei Medizinstudenten.

BACKGROUND: An increased incidence of hazardous alcohol consumption in medical practitioners is widely discussed. We conducted a survey of 80 medical students with a standardized questionnaire in order to assess the impact of harmful drinking patterns on the ideas of recommendations about alcohol consumption intended for patients. The statistical analyses were descriptive and inferential. RESULTS: Only one of 80 medical students rated his own consumption as hazardous. The weekly alcohol median consumption was 30 g for women and 60 g for men. 24% of students answering the AUDIT-questionnaire were found to be in the at-risk consumption category. Every 10th student had more than 6 drinks once per week. The weekly estimated non-risk allowance for patients was 80 g of alcohol in women and 100 g for men. DISCUSSION: In contrast to the self rating we found a high percentage of hazardous drinking behaviour patterns when using standardized instruments. Compared to the WHO recommendations the students rated weekly alcohol consumption more strictly. This points both towards the need of preventive measures in this target group as well as the need to improve educative competency.

The validity of the laboratory marker combinations DOVER and QUVER to detect physician's diagnosis of at-risk drinking.

Especially in situations where it might be favorable for the patient to dissimulate the existing alcohol problem, 'objective' laboratory tests can be helpful. In this study we report validation of the two combinations DOVER (DOctor VERified) and QUVER (QUestionnarie VERified) of the biological markers percent carbohydrate-deficient transferrin (%CDT) and gamma-glutamyl-transferase (gamma-GT) to detect patients that have been identified by their physicians with at-risk drinking behavior. Fifty-eight general practitioners (GPs) participated at two study sites in South-West Germany. Patients filled in a questionnaire that included the alcohol use disorders identification test (AUDIT) and gave a blood sample. The GP recorded his/her assessment about the presence of an alcohol-related disorder in the patient. Receiver operating characteristics (ROC) analyses of the marker combinations DOVER and QUVER were performed. A total of 2940 patients participated in the study, of which 2496 completed data sets that could be used for further analysis. The area under the curve (AUC) of 79.5% for DOVER and 77.2% (QUVER) are in a higher range than the values for gamma%CDT (75.7%) or gamma-GT (72.5%) and %CDT (64.5%) and suggest superiority of the proposed marker combinations. Cross-validation results were almost identical with 76.6% and 73.3% for DOVER and QUVER, respectively. Our analysis demonstrated that the combination of the markers gamma-GT and %CDT with the physician's judgement of the condition as reference was superior to the use of single markers.

The alcohol use disorders identification test for detecting at-risk drinking: a systematic review and meta-analysis.

OBJECTIVE: The purpose of this study was to perform a systematic review of the diagnostic accuracy of the Alcohol Use Disorders Identification Test (AUDIT) for detecting at-risk drinking. METHOD: The MEDLINE, PsycINFO, Science Citation Index Expanded, BIOSIS Previews, Cumulative Index to Nursing and Allied Health Literature (CINAHL), MEDION, and Cochrane Library databases were searched for relevant studies. The criteria for inclusion were a valid reference standard, AUDIT consisting of 10 items, avoiding bias that may result from how the reference standard was obtained, and when and how many participants were tested. Data were extracted independently by two reviewers. Data synthesis was performed by applying direct pooling of proportions and random effects model for likelihood ratios and diagnostic odds ratio. RESULTS: Twenty-three studies were included in the systematic review, 19 of which were included in the meta-analysis. With a cutoff of 8 points, sensitivity ranged from .31 to .89 and specificity ranged from .83 to .96 across the eight studies conducted in primary care. A single trial in general hospital inpatients found a sensitivity of .93 and a specificity of .94; another trial in emergency-department patients found a sensitivity of .72 and a specificity of .88. A study in university students found a sensitivity of .82 and a specificity of .78. Three studies in elderly patients found sensitivities between .55 and .83 at a pooled specificity of .96. There was large heterogeneity between study results, which could only partly be explained by setting diversity. The analysis of results with population-specific cutoff points led to similar findings. CONCLUSIONS: Findings on the diagnostic performance of the AUDIT proved to be largely heterogeneous. Its use should be restricted to primary care populations, inpatients, and elderly patients.

DOVER and QUVER-new marker combinations to detect and monitor at-risk drinking.

BACKGROUND: At-risk drinking is a common medical problem. "Objective" laboratory tests are widely used, especially in situations where it might be favorable for the patient to dissimulate the existing alcohol problem. In this study, we report a new approach to combine the biological markers % carbohydrate-deficient transferrin (%CDT) and gamma-glutamyltransferase (gammaGT) to increase diagnostic properties to identify patients with at-risk drinking behavior. METHODS: Fifty-eight general practitioners (GPs) participated in the study at 2 study sites in South-West Germany. Patients filled in a questionnaire that included the Alcohol Use Disorders Identification Test (AUDIT) and gave a blood sample. The GP recorded his assessment about the presence of an alcohol-related disorder in the patient. Screening results of 1 test center were used as a calculation sample. The results at the other site were used to cross-validate the study outcomes. The markers were combined by 2 methods. The first approach used the AUDIT (QUestionnaire VERified; QUVER), and the second was performed using the clinical judgment of the treating GP (DOctor VERified; DOVER). The formulas were calculated using linear and logistic regression models, respectively. RESULTS: A total of 2,940 patients participated in the study, of whom 2,496 completed data sets that could be used for further analysis. In the receiver-operating characteristics (ROC) curves with the reference standard of an AUDIT> or =8, the area under the curve (AUC) of 78.8% for DOVER and 80.6% (QUVER) are in a higher range than the values for gamma-%CDT (75.4%) or gamma-GT (66.3%) and %CDT (74.3%) and suggest a clear superiority of the proposed marker combinations. Regarding the combinations DOVER and QUVER, the cross-validation results were almost identical, with 78.4/78.8% and 80.6/79.5%, respectively. CONCLUSION: Our study is to date the largest practice-based trial that examines the value of the markers CDT and gamma-GT and their combinations for the screening of at-risk drinking in general practice under routine conditions. Our ROC analysis clearly demonstrated that the combination of the markers gamma-GT and %CDT under routine conditions with a behaviorally oriented reference standard leads to an improvement of diagnostic performance, more so than the use of single markers.